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Abstract — An irregular LDGM-LDPC code is studied as a sub- 
code of an LDPC code with some randomly punctured output- 
bits. It is shown that the LDGM-LDPC codes achieve rates 
arbitrarily close to the channel-capacity of the binary-input 
symmetric-output memoryless (BISOM) channel with bounded 
complexity. The measure of complexity is the average-degree (per 
information-bit) of the check-nodes for the factor-graph of the 
code. A lower-bound on the average degree of the check-nodes of 
the irregular LDGM-LDPC codes is obtained. The bound does 
not depend on the decoder used at the receiver. The stability 
condition for decoding the irregular LDGM-LDPC codes over 
the binary-erasure channel (BEC) under iterative-decoding with 
message-passing is described. 

Index Terms — Bounded-complexity-codes, iterative-decoding, 
capacity-approaching-codes. 

I. Introduction 

Two questions guide much of the research in channel- 
coding: the construction of codes that achieve rates arbitrarily 
close to the capacity of a given channel and efficient decoding 
of these codes. The decoding of error-correcting-codes using 
message-passing over sparse-graphs is considered the state-of- 
the-art. An example of a sparse-graph code is the ensemble 
of low-density parity-check codes Consider a binary- 
input symmetric-output memoryless (BISOM) channel with 
channel-capacity C. Suppose a code is chosen at random from 
a given code-ensemble and achieves a rate (1 — e)C, where 
e e (0,1] is the multiplicative gap-to-capacity. The study of 
the encoding and decoding complexity of code-ensembles in 
terms of the capacity-gap e was proposed by Khandekar and 
McElice |2|. 

Low-density parity-check (LDPC) codes exhibit remarkable 
performance under message-passing decoding. This perfor- 
mance is attributed to the sparseness of the parity-check matri- 
ces of these codes. The density of a parity-check matrix is the 
number of ones in the parity-check matrix per-information-bit. 
The density is proportional to the number of messages passed 
in one round of iterative-decoding. A lower-bound on the 
density of a parity-check matrix in terms of the multiplicative- 
capacity-gap e was obtained in |3| and later tightened in Q. 
For a code defined by a full-rank parity-check matrix, the 



lower-bound on the density is 



where Ki and K2 



depend on the channel and not on code parameters. As the rate 
of code approaches the channel-capacity (e 0), the density 
of the parity-check matrix becomes unbounded. The authors 
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of iU showed that non-systematic irregular-repeat-accumulate 
(NSIRA) codes could achieve rates arbitrarily close to the 
channel-capacity of a BISOM channel with bounded com- 
plexity. The rates close to channel-capacity were achieved 
by randomly puncturing the information bits of the NSIRA 
codes indepedently with a probability that depended on the 
gap to capacity. Recently, the authors of ifTol . ifTTI modeled 
several communication scenarios using parallel channels. This 
model enables (among other things) the investigation of the 
performance of punctured LDPC codes. The effect of random- 
puncturing on the ensemble of {j, k) regular LDPC codes was 
studied in |12|; an upper-bound on the weight spectrum of 
the ensemble of LDPC codes in question was obtained. The 
ensemble of low-density generator-matrix/low-density parity- 
check (LDGM-LDPC) codes was studied in |5|, [6|. This en- 
semble resultes on compounding the LDGM and LDPC codes. 
Hsu |5| proved that codes from the regular LDGM-LDPC 
ensemble could achieve rates arbitrarily close to the channel- 
capacity of the BISOM channel with bounded graphical com- 
plexity. However, the proof of |5| assumed: a regular LDGM 
code with rate 1; a regular LDPC code; and, a maximum- 
likelihood (ML) decoder No puncturing was employed. Pfister 
and Sason |13 | studied capacity achieving degree-distributions 
for the accumulate-repeat-accumulate (ARA) codes over the 
BISOM channel. Using a technique called graph-reduction, 
some capacity-achieving degree-distributions for accumulate 
LDPC (ALDPC) codes were proposed. ALDPC codes were 
shown to be LDGM-LDPC codes with a 2-regular LDGM 
code. In this work, the upper LDGM code can have any rate 
Rg e (0, 1]. Further, the LDPC and LDGM codes can be 
irregular and the requirement for ML decoding is removed. 

This paper obtains lower-bounds on the complexity of 
the ensemble of irregular LDGM-LDPC codes at rates arbi- 
trarily close to the capacity of the binary-input symmetric- 
output memoryless channel for asymptotic block-lengths. The 
information-theoretic bounds obtained in this paper do not 
depend on the type of decoder The LDGM-LDPC codes are 
studied as sub-codes of constrained punctured LDPC codes. 
It is shown that if some variable nodes of the constrained 
punctured LDPC codes are punctured independently with 
probability p — 1 ~ ne (for some constant k), the ensemble 
achieves rates arbitrarily close to channel capacity of BISOM 
channel with bounded complexity. Further, it is shown that 
that the LDGM-LDPC codes are equivalent to the constrained 
punctured LDPC codes when e — !> (or p ^ 1). The perfor- 
mance of the constrained punctured LDPC codes are studied 
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over the binary-erasure channel under iterative-decoding using 
message-passing. The stability conditions are derived. 

This paper is organized as follows. Some preliminary topics 
are introduced in Section LDGM-LDPC codes are modeled 
as sub-codes of constrained punctured LDPC codes in Section 
Hill Performance of the constrained punctured LDPC codes and 
bounds on the average degrees of the factor graph are studied 
in Section |IV] The stability condition for these codes over 
the binary-erasure channel under message-passing decoding is 
studied in Section [V] The paper is concluded in Section [Vl] 

II. Preliminaries 

In this paper, uppercase, lowercase and bold-uppercase 
variables represent random-variables, realization of random 
variables and random-vectors respectively. For example, X is 
a random-variable with a realization x while X is a random- 
vector. 

A. LDGM-LDPC Codes 

Regular LDGM-LDPC codes were studied in 0, IS). In 
this paper, irregular LDGM-LDPC codes are studied. Consider 
the binary random vectors Xi,X2 of length nl^l and nl^l 
respectively. The LDGM-LDPC code is defined as follows: 



C = {Xi : Xi = X2G, XaiJ^ = 0} 



(1) 



where H and G are the random low-density parity-check 
(LDPC) matrix and random low-density generator-matrix 
(LDGM) respectively. Consider the factor-graphs Q-u and Qg 
represented by the matrices H and G respectively. Let Qu be 

n[^] accumulate nodes of the LDGM code 
nl'lbits ofX, 




- LDPC 

nPl LDPC output bits (also serve as LDGM information bits) '^^'^'^^ 
Fig. 1. The LDGM-LDPC Code 

a {n^'^\\H{x), ph{x)) factor-graph with nl^l variable-nodes 
where we define the following generating-functions: 



Ph{x) = ^ 



Phax 



(2) 



where Xha (pH, d is the probability of a randomly chosen edge 
in Q-u being connected to a variable (check) node of degree 
i. Similarly, Let Qg be a {n^^\ \g{x), poix)) factor-graph 
with ?T.[^1 accumulated-nodes where we define the following 
generating-functions: 

-1 



Pg{x) 



^PG,ix' 1 



(3) 



where \q i (pci) is the probability of a randomly chosen edge 
in Qg being connected to a information (accumulate) node of 
degree i. The two factor graphs Qg and are compounded 
to form the LDGM-LDPC code as shown in figure [T| 

III. LDGM-LDPC Codes As a Special LDPC Code 

In this section, the LDGM-LDPC code as defined in ([B is 
shown to be a sub-code of an LDPC code. 

Lemma 1. Consider the binary vector X = (X1X2) that 
results on the concatenation of the two binary vectors Xi 
and X2 (of lengths nl^l and n^^l respectively), which satisfy 
([T]l. A new constraint-matrix is defined as follows: 

T 



H = 



I 



G 



(4) 



where I is the n^^' x n^^l identity matrix, G and H are 
the random LDGM generator-matrix and LDPC parity-check 
matrix of the LDGM-LDPC code (defined in (|7])). Then, the 
code C-H = {X : 'XSHF — 0} is a parity-check code with 
parity-check matrix % which is a mother code of the LDGM- 
LDPC code defined in ([T]). 

Proof: It follows from Q that 

{(XiX2)-H^ = 0} {Xi = X2G and X2i?^ 



0} 



where all arithmetic is over GF(2). The bits Xi are identical 
to the code bits of the LDGM-LDPC code in Thus, the 
code in ([T]) is a sub-code of the code Cu- The vector X is a 
length n parity-check code with a sparse parity-check matrix 
T-L. H is the parity-check matrix of a randomly chosen code 
from the ensemble [n, Xg{x), pg{x), Xh{x), ph{x)). ■ 

IV. Puncturing the Code C-h 

In this section, a random puncturing scheme is introduced 
for the code Cn that was defined in lemma [T] Further, the 
lower-bound on the average density of the irregular LDGM- 
LDPC ensemble is obtained. Consider a length n codeword 
X = {Xi, . . . , Xn} that is transmitted over a BISOM channel. 
A code bit of X is punctured if the output at the BISOM chan- 
nel corresponding to the said code bit is 0. Some puncturing 
schemes for codes were proposed in lfT4]| . which include ran- 
dom puncturing (codeword bits were punctured independently 
with some probability p) or intentional-puncturing (code bits 
were divided into classes and each class had its own puncturing 
probability). 

Remark 1. The codeword X is assumed to be uniformly 
chosen from the code C-^- It is assumed in this paper that 
all the bits of the codeword are equally likely to be or 1. 

The result ifTTl Proposition 2.1] is now restated. It is 
assumed that every codeword bit in X is transmitted though 
one of the J statistically independent BISOM channels, where 
Cj is the capacity of the jth channel (in bits per channel 
use) and PY\x{-\-]j) is the transition probability of the jth 
channel. Let the received message at the channel output be Y. 
The conditional probability-density of the log-likelihood ratio 
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log at the output of the ith channel given the 

input is is denoted by a{.-,j). Let be the set of indices 
of the code bits transmitted over the jth channel, 71 [^1 = l^U)] 
be the size of this set, and pj — ^ be the fraction of bits 
transmitted over the jth channel. For an arbitrary cxn parity- 
check matrix H of the code C, let /3j,m designate the number 
of indices in referring to bits which are involved in the 
mth parity-check equation of H and let i?^ = 1 — ^ be the 
design rate of C. 

Proposition 1. Let C be a binary linear block code of length 
n, and assume that its transmission takes place over a set 
of J statistically independent BISOM channels. Let X = 
{Xi, . . . ,Xn} and'Y = {Yi, . . . ,Yn} designate the trans- 
mitted codeword and received sequence respectively. Then, the 
average conditional entropy of the transmitted codeword given 
the received sequence satisfies 

1 

-if(X|Y)>l-Vp,Q-(l-i?,) 



n 



/ ^ 1 



2n(l -i?d)log2 



E 

p=i 



p{2p - 1 



m—l J — 1 



where 



93.P = a{l;j){l + e ^)tanh'^T^ [£jdl, 



(5) 



je{l,...,J},peN. 



Definition 1. Constrained punctured LDPC code C-h{p)- Let 
C-H be a parity-check code defined in lemma [7] // the first 
Ti^^l bits of this code fXij pass through the channel without 
puncturing and the last n^^l bits of the code ('X.2,) are punc- 
tured independently with probability p, the resulting code is 
represented by C-h{p). 

The following remark explains why the above punctured 
LDPC codes are termed "constrained". 

Remark 2. Let km be a random variable representing the 
number of edges involved in the mth parity-check of a given 
parity-check code. In the bound derived in proposition\l\ l^j^m 
refers to the number of code bits from the jth class that are 
connected to the mth parity-check. For every m, it follows 
that: 



h — 



je[i....,J] 



where J is the number of parallel, statistically independent 
channels. When discussing the code Cfi{p), J = 2. The case 
j = 1 corresponds to the n^^l un-punctured bits (variable 
nodes) Xi and j ~ 2 corresponds to the nl^l bits (variable 
nodes) 0/X2 that are independently punctured with probabil- 
ity p. From the structure of the code Cu{p), each of the first 
n^^l parity-checks are connected to exactly one variable node 
from the first class (bits ofl^x), i.e /3i,m = 1, if m £ [1, nl^l]. 



The number of variable nodes connected to the first n^^l check 
nodes from j — 2 is /?2,m = fcm~l. where is distributed as 
per Pg{-) of © (see figure \l}and]2}. The remaining parity- 
checks of the code C-u(p) are connected to variables nodes 
from the second class (bits of li.2) only. Thus if m > 'n\^\ 
Pi,m = and /?2,m = km, where km is distributed as per 
Ph{-) of (|2]l. To summarize: 

0, otherwise 

: (6) 

km -I, me 

km, otherwise 



Pl,m — 



In parallel LDPC codes of UllH . the members of the sequence 
{/3i,m, ■ • ■ , /3j.m} take on all possible values between 1 and 
km such that /3j,m — km- On the other hand, for the code 
C-uip), Pi.m takes values or 1 only. This follows from: the 
structure of the parity-check matrix Ti of the code C-u ( and of 
C-h{p)); and, the assignment of~K.x and X2 to the two classes 
of parallel channels. 

Claim 1. Let C and C-u [p) represent the codes defined in ([T]) 
and definition Q] respectively. Then, 

lim C-H (p) — C 

The above claim follows from ([T]) and definition [T] because 
in the limit p — ?► 1, all the bits of the lower LDPC code X2 are 
punctured. The codewords of Cu{p) are Xi, which is identical 
to the codewords of C of ([U. 

The following lemma relates the code rate and the condi- 
tional entropy i/(X|Y) of the code defined in definition [T] 

Lemma 2. Let C-h (p) be a code of length n as defined in 
definition m Let ^ be a binary codeword from C-uip)- Let 
Y be a vector sequence of length n at the output of the 
BISOM channel upon transmission of X. Then, the following 
inequality holds: 



1 

-H{X\Y) < —H{P,) 
n n 



(7) 



where is the average bit-error probability of decoding the 
lower LDPC code X2 , tt.'^' is the length of the lower LDPC 
code X2, as defined in ([7]). 



Proof 

-H{X\Y) ^ -i/(Xi,X2|Y) 

n n 

^ ii/(X2|Y) + iH(Xi|Y,X2) 

n n 



-i/(X2|Y) 



(8) 



where = follows from the definition of X, = follows from 
the chain rule of entropy and = follows because for a given 
code C-u{p), the entropy of Xi is zero if X2 is known (this 
follows from Xi = X2G'). Further, 



1 d I 

-H{X2\Y) < - 

n 



.[2] 



1 



i=l 



i=l 



h2{pl 



< — 



^E^ 

i—1 



n 



(9) 



4 



where < follows from the Fano's inequality for binary valued 
random variables and where is the bit error probability 

e 

for the ith bit of X2, < follows from the concavity of the 
binary entropy function and — follows from the definition of 
the average bit-error probability of X2. dD follows from (O 
and m 
In the following theorem, it is assumed that the code length 
71 — ^ 00 and Pb — > 0. An upper-bound on the design-rate 
for the ensemble of parity-check codes defined in lemma [T] is 
obtained. 

Theorem 1. Considera [n, Xg{x), pg{x), Xh{x), ph{x)) en- 
semble as defined in lemma [7] Let li. be a codeword from 
the code Cu (p) that is chosen uniformly from this ensemble. 
Let the first n^^l bits of X pass through a BISOM channel 
with capacity C without puncturing. The last nl^l bits of 
X pass through the BISOM channel after being punctured 
independently with probability p. Let pi — p2 = 

( where pi + P2 = 1 j and let Rh be the design-rate of the 
lower LDPC code in the LDGM-LDPC code. Further, let gl 
and an be the average degrees of the accumulate nodes of the 
LDGM codes and check nodes of the LDPC nodes respectively. 
Then, the design rate Rd of the ensemble is upper-bounded 
as: 

l-{pi + {l-p)p2)C 



Rd < 1 



1 



1 gi,ipi + (l— -Rif )p2 



gl,lPl°I. + (l- J^H)P2°ii 
91,lPl + (l--R/f )P2 



2 log 2 pi + (l-fljf)p2 ^2,1 

where gi i and 52,1 are defined as per 0. 

The above theorem is proved in the appendix. The 
above upper-bound on the design-rate of punctured 
{n, Xg{x), pg{x), Xh{x), ph{x)) ensembles (as defined 
in lemma [T]) can be used to obtain a lower-bound on the 
asymptotic complexity of the code. In the following theorem, 
the lower-bound is obtained. 

Corollary 1. In the limiting case 0/ n — > 00, puncturing the 
last nP^ bits of a codeword (independently with probability p) 

results in a channel capacity C = (1 — p2p)C, where C is 
the capacity of the BISOM channel under consideration. Let 
and be the average degrees of the LDGM accumulate 
nodes and the LDPC check nodes. Let Rh be the rate of the 
lower LDPC code. Then, if the design rate of the ensemble 

Rd — (1 — e)C, the following lower-bound on and 
holds: 

Plffl.lflL + (1 - RH)P2aB. 



pigi,i + (1 - Rh)p2 



> 



-e)C 



^"6V21°g2 Pl+(l--R.ff)P2 ^- 

log(^) 

92,1 ' 

Proof: The design-rate Rd is set to (1 — e)C in the upper- 
bound of theorem [T] and obtain the above bound. ■ 
A direct consequence of the above result is that rates 
arbitrarily close to channel capacity are possible with finite 
complexity. 



Lemma 3. Consider a code [p) discussed in corollary [7] 
Then, in the limit e — > 0, the lower-bound on the average- 
degrees is finite if the puncturing probability p = 1 — Ke, for 
some constant k. 

Proof: Since the last n^^l bits of the code Cnip) are 
punctured independently with probability p, the probability 
density of the log-likelihood ratio (LLR) of those bits is: 



ail;2)^pS„{l) + {l-p)a{l) 



(10) 



where Sq{1) is the Dirac delta function at / = and a{l) is the 
density of the LLR over the original (un-punctured) BISOM 
channel. First, g2.i is simplified. As per (|5]l. 



52,1= / aa;2)(l + e-')tanh2(-j 



dl 



[pSoil) + (1 - p)a(/)](l + e-')tanh2(- j 
= (1-P).9i 



dl 



where = follows from (fTOl i and where gi — a{l){l + 
e~')tanh^^|^(i/. In the limit e — 0, the lower-bound on the 
complexity in corollary [T] is finite if and only if {l~p)gi — rje 
forsome constant r;. Thus, it follows that p = 1 — k€, where 

K = ^. m 

Lemma 4. The lower-bound on complexity of the LDGM- 
LDPC code defined in ([T]) is finite for a BISOM channel. 

Proof: Let X — (X1X2) represent a randomly chosen 
codeword from the code C-u{p)- It follows from lemma|3]that if 
the design rate of this ensemble Rd approaches capacity (e — ^ 
0) and the puncturing probability p of the LDPC code bits X2 
approaches 1, the average lower-bound on the complexity is 
bounded. In the limit n ^ 00 and p ^ \, the code words of 
the code C-h{p) are Xi as all the bits of X2 are punctured. 
Thus, the code words of the code C-h{p) are identical to the 
LDGM-LDPC code defined in O. ■ 

V. Stability Condition for Message Passing 
Decoding of Punctured LDGM-LDPC Codes Over 
THE BBC 

In this section, the decoding of the ensemble of 
(n, Xg{x), pcix), Xnix), ph{x)) codes is studied. The chan- 
nel is assumed to be a BEC with an erasure probability of 
6. It is assumed that the decoder employs iterative-decoding 
using message-passing. The density-evolution technique of 
ifTSl is employed in this work. The main assumption in density- 
evolution is that the message on an edge of the factor-graph 
of a randomly chosen code is independent of the messages 
on all other edges. This assumption is justified because in the 
asymptotic case n — > 00, the fraction of bits involved in finite- 
length cycles vanishes. The density-evolution (DE) equations 
are obtained for the Ith stage of decoding. The fixed-point 
analysis is performed on the DE equations and the stability- 
condition for DE is derived. 

Consider the factor-graph of the LDGM-LDPC code in fig. 
ID The Ith iteration of DE is considered. Let x[ (y[) be the 
erasure probability along a random edge from (to) the nl^l 
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un-punctured LDGM channel bit nodes to (from) the LDGM 
accumulate nodes in the Ith iteration of message-passing. 
Further, let X2 (yi) be the erasure probability along a random 
edge from (to) the n^^l punctured LDPC variable bit nodes to 
(from) the LDGM accumulate nodes. Similarly, let (j/g) be 
the erasure probability along a random edge from (to) the n'^l 
punctured LDPC variable bit nodes to (from) the LDPC check 
nodes. Consider the ni^l LDGM variable nodes. The messages 
from the LDGM variable nodes to the LDGM accumulate 
constraints is an erasure if the original channel symbol that was 
received was an erasure and the message from the accumulate 
constraint to the LDGM node in the ^ — 1th erasure was an 
erasure. This observation is formalized as: 

LDGM variable nodes LDPC variable nodes 




LDGM accumulate nodes LDPC check nodes 



Fig. 2. The erasure probabilitie.s for the LDGM-LDPC codes 



x[^Sy[-' (11) 

Consider the message on a random edge from an LDGM 
accumulate node to a LDGM variable node. An erasure results 
when all at least one message from the LDPC variable nodes 
in the previous iteration were erasures. 

y[ ^ 1 - Rail ~ x'f') (12) 
where Rg{x) — "fyr-^^i^rn- Consider a random edge from 

Jo PG{i)'i* 

an LDPC variable node to the LDGM accumulate node. An 
erasure results on this edge during the kh iteration if all the 
incoming edges are erasures and the variable node was erased 
or punctured. Thus, 

4 = (1 - (1 - S)il ~p))\Giyt')LHiyt') (13) 

where p is the puncturing probability and Lii(x) = "jtt^tyt- 

Jo ^H(t)dt 

The probability along a random edge from a LDGM accumu- 
late node to a LDPC variable node in the kh iteration happen if 
any of the channel outputs are erased in the previous iteration. 

yi = l-(l-x[-')pG{l-x'f') (14) 

Along the lines of ( fTSl l, a randomly chosen edge from an 
LDPC variable node to an LDPC check-node has an erasure 
in the kh iteration if the variable node experienced an erasure 
and all incoming edges carried erasure messages in the I — 1th 
iteration. 

4 = (1 - (1 - <5)(1 - p))LG{y'f')X{l - y'f') (15) 



An erasure along a randomly chosen edge from an LDPC 
check node to an LDPC variable node happens if any incoming 
edge has an erasure. 

yi = l-XH{l-x[-') (16) 

Definition 2. The fixed-points of density-evolution described 
in ( l-/7Hi6l ) are defined as 

limi^oox\ = Xi and limi^aoy\ = yu V« S {1, 2, 3} 
We solve for xi and 0:3 from (II im6t and obtain, 

Ag(1 - (1 - b(\ - Rg{1 - X2)))pg{1 - X2)). 
Lh{1- Ph{1-xs)) 
X3-[l-(l-<5)(l-p)]. 

Lg(1 - (1 - '5(1 - Rg{1 - X2)))pg{1 - X2)). 
Ah(1 - ph{1 - X3)) 

Tlieorem 2. Consider the LDGM-LDPC code ensemble as 
defined in lemma |7] The point X2 = Q is stable during density- 
evolution if 

(1 - (1 - 6){l - p)f\GmG{0)pH{l)XHmH{Q) (18) 

.[J4(1) + Pg(1)]<1 (19) 

The theorem is proved in the appendix. 

As per lemma |3] at rates very close to capacity, if the 
puncturing rate p — 1 — ke, the lower-bound on the complexity 
is finite as the rates are arbitrarily close to capacity. We study 
the stability condition when the rates are chosen very close to 
capacity. 

Lemma 5. When the code rate of the LDGM-LDPC code is 
arbitrarily close to capacity i.e. e — > 0, and p = 1 — Ke, the 
stability condition for iterative decoding is 

\G{Q)LG{Q)pH{l)\H{Q)LH{mLG{^) + PG{^)] < 1 

Proof: Substituting p — 1 — ke and e — > in ( fTSl l proves 
the above lemma. ■ 

VI. Conclusion 

Irregular LDGM-LDPC codes have been shown to be LDPC 
code with some randomly punctured bits. The ensemble of 
irregular LDGM-LDPC codes have been shown to achieve the 
capacity of the BISOM channel with bounded complexity. The 
stability condition for the punctured LDGM-LDPC codes over 
the BEC under message-passing decoding was obtained. 

VII. Discussion 

This paper obtains lower-bounds on the complexity of the 
decoding-complexity of irregular LDGM-LDPC codes. These 
bounds are existential in nature and indicate the existence 
of LDGM-LDPC codes that achieve rates arbitrarily close to 
capacity with puncturing. 
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Appendix 

A. Proof of Theorem |7] 

Proof: From lemma |2l proposition [l] setting n ^ oo and 



function ^h^ Jensen's inequality. From ( |23T l and ( l24l i. 

the sum in ( |22] | becomes 



"(i-fld) J 



2n(l-i?d)log2 



m — 1 J — 1 



■E 

p=i 



p(2p - 1 



n(l--Rd) J 

■ E n^fj'P 

rn— 1 j' — 1 




(20) 



(25) 



By considering the first term of the sum in p in the above 
equation, the above equation can be bounded as follows: 

E 11(5.1)'- 

m=l j=l 



where = results by replacing the average number of edges 
to the LDGM accumulate nodes and LDPC check nodes by 
flL and aji respectively. The right hand side of (l25T l is further 
simplified as follows. 



2n(l-i?d)log2 



(21) 



CH 



92,1 



"[^Iffl.p + CH 



nlilgi^p + ch 



aft 
92p 



Since the first nl^l bits pass through the BISOM channel 
without puncturing, Ci = C. Further, since the last n^^l bits 
of the codeword are punctured, C2 = (1 — p)C. Let c be 
the number of parity checks in the matrix (|4|. Then, c = 
n(l — Rd). Due to the structure of the code, from (|6|l and (01, 
for m G [l,?i[il], /3i,m = 1 and /32,m is distributed as pg{x), 
(defined in (O). Further, for m S [rtl^l + 1, c], /3i,m = and 
/?2,m is distributed as ph{x) (defined in (|2]|). We compute 
the expectation of ( |2T] ) over the distributions pg(-) and Ph{-)- 



--^ aL + —rr, 1 



(26) 



/ 

> is explained as follows. Consider a random-variable B with 
a probability distribution defined as: 



[1 ] , , b = GR 



The expectation E 
as follows: 

"(1--R.d) J 

E E 11(5..)''^ 

m— 1 J — 1 



is computed Consider f{B) — g^p- ^s f{B) is convex in B, from the 



'=EEn(5.p)'^- 

m=l j=l 

E E ri(5.^p)'- 

rn=n[il+li=l 



Jensen's inequality, > follows. From ( l21H26t , and substituting 



(22) 



1 



EX]m=i nf=i(ffi,p)^^''" is evaluated as follows: 



2 log 2 



J 91,l + = ff 



(27) 



[11 J 



EEn(5..p)"-'"="'''E^,,„[gi,,52'p" 

m— 1 J — 1 



(23) 



We make the following substitutions in the above equations 
c/f = (1 — i?//)n[2l, nl^l = piTL and n^^l = p2n, where Rh is 
the rate of the lower LDPC code: 



'^'^'5i,pE/j2,„[g2,p'"] > »^'^'5i,p52 



E/32,™/52,: 



where = follows because /3i.„i = 1, = follows because gi.p 

c 

is a constant as the expectation is w.rt. /32,m, > follows from 
the convexity of the function 52 p" ™d the Jensen's inequality. 
EEm=n[ii+in/=i(5j,p)'^'''" is evaluated as follows: 



o>i-E..Q-(i-i?.)(i-^ 



Plffl,! + (1 - Rh)P 2 
Pl + (1 - Rh)P2 



P191,l»j:, + (l--RH)P2"i? 



(28) 



-52.1 



P191,l + (l-^/f )P2 



E E 11(3.^: 

m=n[il + l j = l 



ft.. 



C-ffE/3, „[52fp'"] > C_f/52,i 



(24) 



where c/f = c — ril^l is the number of parity-checks in the 
lower LDPC layer of the LDGM-LDPC code, where = follows 



By replacing Ci = C, C2 = (1 — p)C and solving for Rd in 
the above equation, we obtain the desired bound. ■ 

B. Proof of Theorem |2] 

Proof: The equations ( fTTl ) can be represented as 



because /3i 



0, > follows from the convexity of the 



X2 = ?/'A(a;2,a;3), 



a;3 = i/'s(a;2,a;3) 



7 



Consider a fixed point in the density-evolution {x2,X3) — 
{x2,x^). The above functions can be linearly approximated 
in the neighbor of the fixed point as follows, 



[16] M. Raina and P. Spasojevic, "Decoding Complexity of IiTegu- 
lar LDGM-LDPC C odes Over the BISOM Channels," [ONLINE] 
|http://www.arxiv.org| 



■)Pa{x2,X3) = X2 



dip A . dlpA dx3 



dx2 



8x3 dX2 



{X2 - X2) + 0{X2 - X^Y 

(29) 



Since X3 = iPb{x2, X3), taking derivatives on both sides, 

dx3 dipB _|_ dipB dx3 
dx2 dx2 dx3 dx2 



Substituting ^ from 

i^A{x2,X3) = X2 
+0{X2 -X°2f 

For stability. 



dx2 
into 

8X2 



(30) 



3X2 



dx3 l-^ 
0x3 _ 



{X2 ~ X°2) 



9ipA 

dx2 



dipA 



l_ 



< 1. Evaluating the 



derivatives ancf substituting X2 = x^ — 0, the result is 
obtained. ■ 
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